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ABSTRACT 


Organization  and  maintenance  of  an  index  for  a  dynamic  random 
access  file  is  considered.  It  is  assumed  that  the  index  must  be  kept 
on  some  pseudo  random  access  backup  store  like  a  disc  or  a  drum.  The 
index  organisation  described  allows  retrieval,  insertion,  and  deletion 
of  keys  in  time  proportional  to  .log^I  where  I  is  the  size  of  the 
index  and  k  is  a  device  dependent  natural  number  such  that  the  per¬ 
formance  of  the  scheme  becomes  near  optimal.  Storage  utilization  is  at 
least  50%  but  generally  much  higher.  The  pages  of  the  index  are  organized 
in  a  special  dat a-structure ,  so-called  B-trees.  The  scheme  is  analyzed, 
p»-. rf ormance  bounds  are  obtained,  and  a  near  optimal  k  is  computed. 
Kxperiments  have  been  performed  with  indices  up  to  100,000  keys.  An 
index  of  size  15,000  (100,000)  can  be  maintained  with  an  average  of  9 
(at  least  4)  transactions  per  second  on  an  IBM  360/44  with  a  2311  disc. 

Key  Words  and  Phrases:  Data  structures,  random  access  files,  dynamic 
index  maintenance,  key  insertion,  key  deletion,  key  retrieval,  paging, 
information  retrieval. 

CR  Categories:  3.70,  k7i,  3.74. 


1.  Introduction 


In  this  paper  we  consider  the  problem  of  organizing  and  maintaining 
an  index  for  a  dynamically  changing  random  access  file.  By  an  index 
we  mean  a  collection  of  index  elements  which  are  pairs  (x,a)  of  fixed 
size  physically  adjacent  data  items,  namely  a  key  x  and  some  associated 
information  a.  The  key  x  identifies  a  unique  element  in  the  index, 
the  associated  information  is  typically  a  pointer  to  a  record  or  a 
collection  of  records  in  a  random  access  file.  For  this  paper  the 
associated  information  is  of  no  further  interest. 

We  assume  that  the  index  itself  is  so  voluminous  that  only  rather 
small  parts  of  it  can  be  kept  in  main  store  at  one  time.  Thus  the  bulk 
of  the  index  must  be  kept  on  some  backup  store.  The  class  of  backup 
stores  considered  are  pseudo  random  access  devices  which  have  a  rather 
long  access  or  wait  time — as  opposed  to  a  true  random  access  device  like 
core  store — and  a  rather  high  data  rave  once  the  transmission  of  physically 
sequential  data  has  been  initiated.  Typical  pseudo  random  access  devices 
are:  fixed  and  moving  head  discs,  drums,  and  data  cells. 

Since  the  data  file  itself  changes,  it  must  be  possible  not  only 
to  search  the  index  and  to  retrieve  elements,  but  also  to  delete  and  to 
insert  keys — more  accurately  index  elements — economically.  The  index 
organization  described  in  this  paper  always  allows  retrieval,  insertion, 
and  deletion  of  keys  in  time  proportional  to  log^I  or  better,  where  I 
is  the  size  of  the  index,  and  k  is  a  device  dependent  natural  number 
which  describes  the  page  size  such  that  the  performance  of  the  maintenance 


and  retrieval  scheme  becomes  near  optimal* 


In  more  illustrative  terms  theoretical  analysis  and  actual  experi- 
nts  show  that  it  is  possible  to  maintain  an  index  of  size  15000 
with  an  average  of  9  retrievals,  insertions,  and  deletions  per  second 
in  real  time  on  an  IBM  360/44  with  a  2311  disc  as  backup  store.  According 
to  our  theoietical  analysis,  it  should  be  possible  to  maintain  an 
index  of  size  1500000  with  at  least  two  transactions  per 
second  on  such  a  configuration  in  real  time. 

The  index  is  organized  in  pages  of  fixed  size  capable  of  holding  up 
to  2k  keys,  but  pages  need  only  be  partially  filled.  Pages  are  the 
blocks  of  information  transferred  between  main  store  and  backup  store. 

The  pages  themselves  are  the  nodes  of  a  rather  specialized  tree, 
a  so-called  B-tree,  described  in  the  next  section.  In  this  paper  these 
trees  grow  and  contract  in  only  one  way,  namely  nodes  split  off  a  brother, 
or  two  brothers  are  merged  or  "catena ted"  into  a  single  node.  The  splitting 
and  catenation  processes  are  initiated  at  the  leaves  only  and  propagate 
toward  the  root.  If  the  root  node  splits,  a  new  root  must  be  Introduced, 
and  th  is  is  the  only  way  in  which  the  height  of  the  tree  can  increase. 

The  opposite  process  occurs  if  the  tree  contracts. 

There  are,  of  course,  many  competitive  schemes,  e.g.,  hash-coding, 
for  organizing  an  index.  For  a  large  class  of  applications  the  scheme 
presented  in  this  paper  offers  significant  advantages  over  others: 
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i)  Storage  utilization  is  at  least  50%  at  any  time  and  should 
be  considerably  better  in  the  average. 

ii)  Storage  is  requested  and  released  as  the  file  grows  and  con¬ 
tracts.  There  is  no  congestion  problem  or  degradation  of 
performance  if  the  storage  occupancy  is  very  high. 

iii)  The  natural  order  of  the  keys  is  maintained  and  allows  pro¬ 
cessing  based  on  that  order  like:  find  predecessors  and 
successors;  search  the  file  sequentially  to  answer  queries; 
skip,  delete,  retrieve  a  number  of  records  starting  from  a 
given  key. 

iv)  If  retrievals,  insertions,  and  deletions  come  in  batches, 

very  efficient  essentially  sequential  processing  of  the  index 
is  possible  by  presorting  the  transactions  on  their  keys 
and  by  using  a  simple  prepaging  algorithm. 


B-T rees 


De  f .  2.1:  Let  h  2  0  be  an  integer,  lc  a  natural  number.  A  directed 
tree  T  is  in  the  class  T(k,h)  of  3- trees  if  T  is  either  empty  (h=0) 
or  has  the  following  properties: 

i)  Kach  path  from  the  root  to  any  leaf  has  the  same  length  h, 

also  called  the  height  of  T,  i.e.,  h  =  number  of  nodes  in  path. 

ii)  Kach  node  except  the  root  and  the  leaves  has  at  least  k  +  1 
sons.  The  root  is  a  leaf  or  has  at  least  two  sons. 

iii)  Kach  node  has  at  most  2k  +  1  sons. 

Number  of  Nodes  in  B-T rees:  Let  N  .  and  N  be  the  minimal  and 

-  min  max 

maximal  number  of  nodes  in  a  B-tree  T  e  x(k,h).  Then 

N  =  1  +  2((k+1)0  +  (k+D1  +  •••  +  (k+l)h_2)  =  1  +  |  ((k+l)h_1-l) 

for  h  il  2.  This  also  holds  for  h  =  1 .  Similarly  one  obtains 

h-l  .  .  .  h  , 

X  =  x  (2k+ 1) 1  =  ((2k+l)  - 1 ) :  h  l  1. 

max  2k  V  ' 

i=0 

Upper  and  lower  bounds  for  the  number  N(T)  of  nodes  of  T  e  i(k,h)  are 
given  by: 

N(T)  =  0  if  T  r  t (k ,0) ;  (2.1) 

1  +  ((k+1)11  -lj  _  N(T)  *  ^  ^(2k+l)^-lj  otherwise. 

Xete  that  t lie  classes  (k,h)  need  not  be  disjoint. 
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3.  The  Data  Structure  and  Retrieval  Algorithm 

To  repeat,  the  pages  on  which  the  index  is  stored  are  the  nodes  of 
a  B-tree  T  c  i(k,h)  and  can  hold  up  to  2k  keys.  In  addition  the 
data  structure  for  the  index  has  the  following  properties: 

i)  Lach  page  holds  between  k  and  2k  keys  (index  elements) 
except  the  root  page  which  may  hold  between  1  and  2k 
keys . 

ii)  Let  the  number  of  keys  on  a  page  P,  which  is  not  a  leaf,  be 
l .  Then  P  has  L  +  1  sons  . 

iii)  Within  each  page  P  the  keys  are  sequential  in  increasing 

order:  x ^ ,  x2 ,  .  x ;  k  1  i  i  2k  except  for  the  root  page 
for  which  1  1  l  1  2k.  Furthermore,  P  contains  £  +  1 
pointers  p^,  p  to  the  sons  of  P.  On  leaf  pages 

these  pointers  are  undefined.  Logically  a  page  is  then 
organized  as  shown  in  Figure  1. 
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Figure  1 .  Organization  of  a  Page 

The  a  are  the  associated  information  in  the  index  element 
( xi , ctf ) .  The  triple  (xi»a^,Pi)  or— omitting  ou  —  the  pair 
(x  ,p  )  is  also  called  an  entry. 

iv)  Let  P(p^)  be  the  page  to  which  p^  points,  let  K(p^) 


ae  the  set  of  keys  on  the  pages  of  that  maximal  subtree  of 
which  P(p^)  is  the  root*  Then  for  the  B-trees  considered  here 
the  following  conditions  shall  always  hold: 

(vy  e  <  x,)  (3.1) 

(vy  «  K(p.))  (x.  <  y  <  xi+1);  i  =  1,2 . l-l  (3.2) 

i  Vy  »•  K(p  ) )  (x,  <  y)  (3.  3) 

'  ^  K. 

Figure  2  is  an  example  of  a  B-tree  in  1(2*3)  satisfying  all  the  above 
conditions.  In  the  figure  the  are  not  shown  and  the  page  pointers 

are  represented  graphically.  The  boxes  represent  pages  and  the  numbers 
outside  are  page  numbers  to  be  used  later. 

Retrieval  Algorithm:  The  flowchart  in  Figure  3  is  an  algorithm  for 
retrieving  a  key  y.  Let  p,r,s  be  pointer  variables  which  can  also 
assume  the  value  "undefined"  denoted  as  u.  r  points  to  the  root  and  is 
u  if  the  tree  is  empty,  s  does  not  serve  any  purpose  for  retrieval, 
but  will  be  used  in  the  insertion  algorithm.  Let  P(p)  be  the  page  to 
which  p  is  pointing,  then  x  are  the  keys  in  P(p)  and 

i  ^ 

p  ,  .  .  .  *p  the  page  pointers  in  P(p) . 

The  retrieval  algorithm  is  simple  logically,  but  to  program  it  for 
a  computer  one  would  use  an  efficient  technique,  e.g.,  a  binary  search, 
to  scan  a  page. 

Cost  of  Retrieval:  Let  h  be  the  height  of  the  page  tree.  Then  at 
most  h  pages  must  be  scanned  and  therefore  fetched  from  backup  store 
to  retrieve  a  key  v.  Wo  will  now  derive  bounds  for  h  for  a  given  index 


Figure  2.  A  Data  Structure  in 
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Kiguro  5.  Retrieval  Algorithm 
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of  size  I,  The  minimum  and  maximum  number 
in  a  B-tree  of  pages  in  r(k,h)  are: 


I  . 
nun 


and  I 


I  . 
mm 


1  +  M2 


(k+pb^-ll 


2(k+l)1'-1  -  1 


I 

max 


2k 


(?k+l)h-l\ 

,  2k  / 


(2k+l)h  -  1 


This  is  immediate  from  (2.1)  for  h  .  1.  Thus  we  have  as 
for  the  height  h: 


l0*2k+l(,+U 


h  1  1  + 


for  I  >  1, 


h  =  0  for  1=0. 


of  keys 

max 


sharp  bounds 


(3.1) 
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4 .  key  Insertion 

The  algorithm  in  Figure  4  inserts  a  single  key  y  into  an  index 
described  in  Section  3.  The  variable  s  is  a  page  pointer  set  by  the 
retrieval  algorithm  pointing  to  the  last  page  that  was  scanned  or  having 
the  value  u  if  the  page  tree  is  empty. 

Splitting  a  Page:  If  a  page  P  in  which  an  entry  should  be  inserted 
is  already  full,  it  will  be  split  into  two  pages.  Logically  first  insert 
the  entry  into  the  sequence  of  entries  in  P — which  is  assumed  to  be  in 
main  store — resulting  in  a  sequence 

P0, (X, .Pj) , (x2,p2) , . . (^2k+1 *P2k+1> 

Now  put  the  subsequence  pQ » (x^ ,p , . . . , (x^,p^)  into  P  and  introduce 
a  new  page  P r  to  contain  the  subsequence 

Pk+1  ’  (xk+2  *Pk+2^  ’  ^*k+3,Pk+3^  ’  *  *  *  ’  ^X2k+l  ,P2k+P  ' 

Let  Q  be  the  father  page  of  P,  Insert  the  entry  where 

p’  points  to  P'  ,  into  Q.  Thus  P*  becomes  a  brother  of  P. 

Inserting  (x^_,,pf)  into  Q  may,  of  course,  cause  Q  to  split 
too,  and  so  on,  possibly  up  to  the  root.  If  the  splitting  page  P  is 
the  root,  then  we  introduce  a  new  root  page  Q  containing  p,(Xk+j>p') 
where  p  points  to  P  and  pf  to  Pf. 

Note  that  this  insertion  process  maps  B- trees  with  parameter  k 
into  B-trees  with  parameter  k,  and  preserves  properties  (3.1),  (3.2), 


in i!  (  1.3), 
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To  illustrate  the  insertion  process,  insertion  of  key  9  into  the 
tree  in  Figure  5  with  parameter  k  =  2  results  in  the  tree  in  Figure 

2. 


(1)  Key  y  is  already  in  index,  take  appropriate  action. 


Figure  4.  Insertion  Algorithm 
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Figure  5.  Index  structure  in  t(2,2) 
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5  *  Cost  of  Retrievals  and  Insertions 

To  analyze  the  cost  of  maintaining  an  index  and  retrieving  keys 
we  need  to  know  how  many  pages  must  be  fetched  from  the  backup  store 
into  main  store  and  how  many  pages  must  be  written  onto  the  backup  store. 
For  our  analysis  we  make  the  following  assumption:  Any  page,  whose  content 
is  examined  or  modified  during  a  single  retrieval,  insertion,  or  deletion 
of  a  key,  is  fetched  or  paged  out  respectively  exactly  once.  It  will 
become  clear  during  the  course  of  this  paper  that  a  paging  area  to  hold 
h  +  1  pages  in  main  store  is  sufficient  to  do  this. 


Any  more  powerful  paging  scheme,  like,  e.g.,  keeping  the  root  page 
permanently  locked  in  main  store,  will,  of  course,  decrease  the  number 
of  pages  which  must  be  fetched  or  paged  out.  We  will  not,  however, 
analyze  such  schemes,  although  we  have  used  them  in  our  experiments. 


Denote  by  f  .  (f  )  the  minim  n  (maximal)  number  of  pages 
J  min  max 

fetched,  and  by  w  .  (w  )  the  minimal  (maximal)  number  of  pages 
J  mm  max 

wri tten. 


Cost  of  Retrieval:  From  the  retrieval  algorithm  it  is  clear  that  for 
retrieving  a  single  key  we  get 

f.  -  1;  f  -  h;  w  .  =w  =0; 
min  max  min  max 

Cost  of  Insertion:  For  inserting  a  single  key  the  least  work  is  required 
if  no  page  splitting  occurs,  then 


min 


min 


=  i; 


=  h;  w 
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Most  work  is  required  if  all  pages  in  the  retrieval  path  including 
the  root  page  split  into  two.  Since  die  retrieval  path  contains  h 
pages  and  we  have  to  write  a  new  root  page,  we  get; 

f  =  h ;  w  =  2h  +  1 

max  max 

Note  that  h  aLways  denotes  the  height  of  the  old  tree.  Although 
this  worst  bound  is  sharp,  it  is  not  a  good  measure  for  the  amount  of 
work  which  must  generally  be  done  for  inserting  one  key. 

If  we  consider  an  index  in  which  keys  are  only  retrieved  or  inserted, 

bit  no  keys  are  deleted,  then  we  can  derive  a  bound  for  the  average  amount 
of  work  to  be  done  for  building  an  index  of  I  keys  as  follows: 

inch  page  split  causes  one  (or  two  if  the  root  page  splits)  new 
pages  to  be  created.  Thus  the  number  of  page  splits  occurring  in  building 
•in  i ; ! vlt* ::  of  L  items  is  bounded  by  n(I)  -  1,  where  n(I)  is  the  number  of 
pages  in  the  tree.  Since  each  page  has  at  least  k  keys,  except  the  root  page 
whin:  may  have  only  1,  we  get:  n(I)  -  — ~  +  ^ •  Each  single  page  split 

causes  at  most  2  additional  pages  to  be  written.  Thus  the  average 
number  of  pages  written  per  single  key  insertion  due  to  page  splitting 


(ri(I)  -  i)  *  “  ~  . 

race  split  does  not  require  any  additional  page  retrievals.  Thus  in 
aw  rare  for  an  index  without  deletions  we  get  for  a  single  insertion: 


l  -  h ;  w 
a  a 


1  + 
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6 •  Deletion  Process 

In  a  dynamically  changing  index  it  must  be  necessary  to  delete 
keys.  The  algorithm  of  Figure  6  deletes  one  key  v  from  an  index  and 
maintains  our  data  structure  properly.  It  first  locates  the  key,  say 
y^.  To  maintain  the  data  structure  properly,  y  is  deleted  if  it  is 
on  a  leaf,  otherwise  it  must  be  replaced  by  the  smallest  key  in  the 
subtree  whose  root  is  P(p^) .  This  smallest  key  is  found  by  going 
from  P(p^)  along  the  pp  pointers  to  the  leaf  page,  say  L,  and 
taking  the  first  key  in  L.  Then  this  key,  say  x^,  is  deleted  from 
L.  As  a  consequence  L  may  contain  fewer  than  k  keys  and  a  catena¬ 
tion  or  underflow  between  L  and  an  adjacent  brother  is  performed. 


Ca  tenatio  i:  Two  pages  P  and  P*  are  called  if 

they  have  the  same  father  Q  and  are  pointed  to  by  adjacent  pointers 
in  Q.  P  and  P*  can  be  catenated,  if  together  they  have  no  more  than 
2k  keys,  as  follows:  The  three  pages  of  the  form 


,(y._i,p),(yrP,),(y.+1>P.+  !)..., 


u 


can  be  replaced  by  two  pages  of  the  form 

_Q _ 


.,(yj_1,p).(yj+1,pi+1).-*-  1 


,(x,,p,) . (Xj,p  ),(y.,p,.),U:i+  ,r ,+  >••••  I 


* 
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As  a  consequence  of  deleting  the  entry  (y^p*)  from  Q  it  is  now 
possible  that  Q  contains  fewer  than  k  keys  and  special  action  must 
be  taken  for  Q.  This  process  may  propagate  up  to  the  root  of  the 
t  ree . 

Underflow:  If  the  sum  of  the  number  of  keys  in  P  and  P*  is  greater 
than  2k,  then  the  keys  in  P  and  P!  can  be  equally  distributed, 
the  process  being  called  an  underflow,  as  follows: 

Perform  the  catenation  between  P  and  P*  resulting  in  too  large 
a  P.  This  is  possible  since  P  is  in  main  store.  Now  split  P 
“in  the  middle'1  as  described  in  Section  4  with  some  obvious  minor  modi¬ 
fies  tions  * 

Note  that  underflows  do  not  propagate.  Q  is  modified,  but  the 
number  of  keys  in  it  is  not  changed. 

To  illustrate  the  deletion  process  consider  the  index  in  Figure  2. 
Deleting  key  9  results  in  the  index  in  Figure  5. 


4 


Figure  6.  Deletion  Algorithm 


-18- 


7  .  host  of  Do  let  ions 

Kor  a  successful  deletion,  i.e.,  if  the  key  y  to  be  deleted  is  in 
the  index,  the  least  amount  of  work  is  required  if  no  catenations  or 
underflows  are  performed  and  y  is  in  a  leaf.  This  requires: 

f  .  -  h ;  w  .  =  1 ; 

min  min 

If  y  is  not  in  a  leaf  and  no  catenations  or  underflows  occur, 

then 


f  =  h;  w  =  2; 


A  maximal  amount  of  work  must  be  done  if  all  but  the  first  two  pages 
in  the  retrieval  path  are  catenated,  the  son  of  the  root  in  the  retrieval 
pa tii  has  an  underflow,  and  the  root  is  modified.  This  requires: 


f 

max 


2h 


w 

max 


h  +  1; 


A*  in  the  case  of  the  insertion  process  the  bounds  obtained  are 
sharp,  but  very  far  apart  and  assumed  rarely  except  in  pathological 
examples.  To  obtain  a  more  useful  measure  for  the  average  amount  of 
work  necessary  to  delete  a  key,  let  us  consider  a  "pure  deletion  process" 
during  which  all  keys  in  an  index  I  are  deleted,  but  no  keys  are 
i  ii  s  c  r  t  e  d . 


Disregarding  for  tile  moment  catenations  and  underflows  we  may  get 
t  =  n  and  w,  =2  for  each  deletion  at  worst.  But  this  is  the  best 
hound  obtainable  if  one  considers  an  example  in  which  keys  are  always 
let*- a  from  the  root  page. 
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Kach  deletion  causes  at  most  one  underflow,  requiring  f  '  1 
additional  fetches  and  w  =  2  additional  writes. 


The  total  number  of  possible  catenations  is  bounded  by 
n(I)  -  1,  which  is  at  most  *  ^  ^  .  Kacli  catenation  causes  1 
additional  fetch  and  2  additional  writes,  which  results  in  an  average 


I  /IdL\  ,  I 

I  '  k  /  k 


2  /I-l\  2 

I  (~ )  k 


Thus  in  the  average  we  get: 

f  =  f,  +f_  +  f,  <h+l  +  r- 

a  1  2  3  k. 

2  2 

w  =  w.  +  w  +w^<2  +  2+  r-  =  4  +  —  . 
a  1  2  3  k  k 
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8.  Page  Overflow  and  Storage  Utilization 

In  the  scheme  described  so  far  utilization  of  back-up  store 
may  be  as  low  as  50%  in  extreme  cases — disregarding  the  root  page — if 
all  pages  contain  only  k  keys.  This  could  be  improved  by  avoiding 
certain  page  splits. 

An  o:v>'/Ye;J  between  two  adjacent  brother  pages  P  and  P*  can  be 
performed  as  follcws:  Assume  that  a  key  must  be  inserted  in  P  and 
P  is  already  full,  but  P*  is  not  full.  Then  the  key  is  inserted 
into  the  key-sequence  in  P  and  an  underflow  as  described  in  Section  6 
between  the  resulting  sequence  and  P'  is  performed.  This  avoids  the 
need  to  split  P  into  two  pages.  Thus  a  page  will  be  split  only  if 
be th  adjacent  brothers  are  full,  otherwise  an  overflow  occurs. 

In  an  index  without  deletions  overflows  will  increase  the  storage 
utilization  in  the  worst  cases  to  about  66%.  If  both  insertions  and 
deletions  occur,  then  the  storage  utilization  may  of  course  again  be  as 
low  as  50%.  For  most  practical  applications,  however,  storage  utilization 
should  be  improved  appreciably  with  overflows. 

One  could,  of  course,  consider  a  larger  neighborhood  of  pages  than 
just  the  adjacent  brothers  as  candidates  for  overflows,  underflows, 
and  -  a tenacious  and  increase  the  minimal  storage  occupancy  accordingly. 

iii  unds  for  tin*  cost  of  insertions  for  a  scheme  with  overflows  are 
u  :is  i  1  v  do  r  i  veil  as : 


f  .  *  h ;  w  . 

nun  min 


1; 


f 

max 


3h  -  2;  w  «  2h  +  1 
max 
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For  a  pure  insertion  process  one  obtains  as  bounds  for  the  average 

cos  t : 


f  <  ii  +  2  + 
a 


2 

k> 


o 


It  is  easy  to  construct  examples  in  which  each  insertion  causes  an 
overflow,  thus  these  bounds  cannot  be  improved  very  much  without  special 
assumptions  about  the  insertion  process. 
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9 .  Maintenance  Cost  for  Index  with  Insertions  and  Deletions 

The  main  purpose  of  this  paper  is  to  develop  a  data  structure  which 
allows  economical  maintenance  of  an  index  in  which  retrievals,  insertions 
and  deletions  must  be  done  in  any  order.  We  will  now  derive  bounds  on 
the  processing  cost  in  such  an  environment. 

The  derivation  of  bounds  for  retrieval  cost  did  not  make  any  assump¬ 
tions  about  the  order  of  insertions  or  deletions,  so  they  are  still  valid 
Also,  the  minimal  and  maximal  bounds  for  the  cost  of  insertions  and  dele¬ 
tions  were  derived  without  any  such  assumptions  and  are  still  valid.  The 
bounds  derived  for  the  average  cost,  however,  are  no  longer  valid  if 
insertions  and  deletions  are  mixed. 

The  following  example  shows  that  the  upper  bounds  for  the  average 
cost  cannot  be  improved  appreciably  over  the  upper  bounds  of  the  cost 
derived  for  a  single  retrieval  or  deletion. 

i'.xamp  le :  Consider  the  trees  T9  in  Figure  2  and  Tr  in  Figure  5. 
lie  le ting  key  9  from  T,  leads  to  and  inserting  key  9  in  T^ 

leads  back  to  1\  .  Consider  a  sequence  of  alternating  deletions  and 
insertions  of  key  9  being  applied  starting  with  T,. 

i  .is.1  I:  No  page  overf  lows,  but  only  page  splits  occur: 

i)  Each  deletion  of  key  9  from  T?  requires: 

5  retrievals  to  locate  key  9,  namely  pages  1,  2,  6. 
i  retrieval  of  brother  5  of  page  6  to  find  out  that 
pages  5  and  b  can  be  catenated. 


1 
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2  pages,  namely  5  and  2  are  modified  and  must  be  written. 

Pages  6  and  3  are  deleted  from  the  tree  T2  . 

Thus  f  =  5  and  w  =  2.  But  f=5=2h-l=f  and 

max 

w  =  2  =  h—  l=w  -2. 

max 

ii)  Each  insertion  of  key  9  into  requires: 

2  retrievals  to  locate  slot  for  9  in  page  5. 

3  pages  must  be  written,  namely  1,  2,  3,  5,  6. 

Thus 

f  «  2  -  h  -  f 

max 

w  =  5  =  2h+l  =  w 

max 

Case  2 :  Consider  a  scheme  with  page  overflows. 

i)  Deletion  of  key  9  leads  to  the  same  results  as  in  Case  1. 

ii)  Insertion  of  key  9  requires: 

2  retrievals  to  locate  slot  for  9  on  page  5. 

2  retrievals  of  brothers  4  and  7  of  5  to  find  out  that 
5  must  be  split. 

5  pages  must  be  written  as  in  Case  1. 

Thus : 

f=4=3h-2=f 

max 

w  =  5  =  2h+l  =  w 

max 

Analogous  examples  can  be  constructed  for  arbitrary  h  and  k. 

From  the  analysis  it  is  clear  that  the  performance  oi  our  scheme  depends 


on  the  actual  sequence  of  insertions  and  deletions.  The  interference 
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between  insertions  and  deletions  "»ay  degrade  the  performance  of  the 
scheme  as  opposed  to  doing  insertions  or  deletions  only.  But  even  in 
the  worst  cases  this  interference  degrades  the  performance  at  most  by  a 
factor  of  3. 

It  is  an  open  question  how  important  this  interference  is  in  any 
actual  applications  and  how  relevant  our  worst  case  analysis  is. 
Although  the  derivable  cost  bounds  are  worse 4  the  scheme  with  overflows 
performed  better  in  our  experiments  than  the  scheme  without  overflows. 
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10 .  Choice  of  k 

The  performance  of  our  scheme  depends  on  the  parameter  k,  Thus 
care  should  be  taken  in  choosing  k  to  make  the  performance  as  good  as 
possib le • 

To  obtain  a  very  rough  approximation  to  the  performance  of  the 
scheme  we  make  the  following  assumptions: 

i)  The  time  spent  for  each  page  which  is  written  or  fetched  can 
be  expressed  in  the  form: 

t  4-  $(2k+l)  +  y  &n(vk+l) 

a:  fixed  time  spent  per  page,  e.g.,  average  disc  seek  time 

plus  fixed  CPU  overhead,  etc. 
transfer  time  per  page  entry, 
y:  constant  for  the  logarithmic  part  of  the  time,  e.g., 

for  a  binary  search. 

v:  factor  for  average  page  occupancy,  1  1  v  <  2. 

We  assume  that  modifying  a  page  does  not  require  moving  keys  within 
a  page,  but  that  the  necessary  channel  subcommands  are  generated  to 
write  a  page  by  concatenating  several  pieces  of  information  in  main 
store.  This  is  the  reason  for  our  assumption  that  fetching  and  writing 
a  page  takes  the  same  time. 

i)  The  average  number  of  pages  fetched  and  written  per  single 

transaction  in  an  environment  of  mixed  retrievals,  insertions, 
and  deletions  is  approximately  proportional — see  Figure  7 — to 


4 
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h,  say  6h.  The  total  time  T  spent  per  transaction  can 
then  be  approximated  by: 

T  ~  6h (a+3 (2k+l)+y  £n(vk+l))  .  Approximating  h  itself  by: 
h  ~  log^^i  (1+1)  where  I  is  the  size  of  the  index,  we  get: 

T  =  6  log  k  (1+1)  (ot+3  (2k+l)+y  Jcn(vk+l)j 

Now  one  easily  obtains  the  minimum  of  T  if  k  is  chosen  such 
7  a 

that : 

j  ^  ((vk+l)  £n(vk+l)  -  (2k+l)j  =  f(k,v) 


Neglecting  CPU  time,  k  is  a  number  which  is  characteristic  for 
the  device  used  as  backup  store.  To  obtain  a  near  optimal  page  size 
for  our  test  examples  we  assumed  a  =  50  ms  and  8  =  90  ys .  According 


to  the  table  in  Figure  8  an  acceptable  choice  should  be  64  <  k  <  128. 
For  reasons  of  programming  convenience  we  chose  k  =  60  resulting  in  a 
page  size  of  120  entries. 


k 

f(k,l) 

f (k, 1.5) 

f  (k  ,2) 

2. OOOOOE+OO 

1.59167E+00 

2 . 3935PE+00 

3.04710E+C0 

4. OOOOOE+OO 

7.09437E+00 

9. 16182E  +  00 

1 . 07750E+01 

8. oooooe+oo 

2 . 2  5500E  +  01 

2.74591E+01 

3. 11646E+01 

1. 60000E+01 

6.33292E+01 

7.42958E+01 

8.23847E+01 

3.20000E+01 

1 . 65769  E  +  02 

1.892G5E+02 

2.06334E+02 

G.40000E+01 

4.13G70E+02 

4. 62662 E+ 02 

4.9791 5E+02 

1 . 28000E+02 

9. 96S31E+02 

1 . 09  726  E+C  3 

1.16911E+03 

2 . 5G000E+02 

2 . 33922E+03 

2.54299E+03 

2.68826E+03 

5.12000E+02 

5.37752E+03 

5 . 78842E+03 

6. 08075E+03 

1.02400E+03 

1. 21625E+04 

1.29881E+04 

1.35748E+04 

2.04S00E+03 

2.71506  E  +  04 

2 . 88062  E  +  04 

2.99818E+04 

4 . 09600  E  +  03 

5.99647E+04 

6. 32806 E+04 

6 . 5  6  3  4  3  E  +  0  4 

8.192Q0E+03 

1. 312G9E+05 

1.37906E+05 

1.42F17E+05 

1. 63840E+04 

2.85235E+05 

*>.985146+05 

3.07938E+05 

3.27680E+04 

6.15877E+05 

6. 42442E  +  05 

6.61292E+05 

6.55360E+04 

1. 32258E+06 

1 . 37572E+06 

1.41342E+0E 

Figure 

8.  The  Function 

f (k , v)  for  Opti 

mal 

Choice  of  k 
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The  size  of  the  index  which  can  be  stored  for  k  =  60  in  a  page 
of  a  certain  height  can  be  seen  from  Figure  9. 


Height  of 
page  tree 

1 

2 

3 

4 


Minimum 
index  size 

1 

121 
7441 
45  3961 


Figure  9,  Height  of  Page  Tree  and 
Index  Size 


Maximum 
index  size 

120 

14640 

1771560 

214358880 
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11.  Experimental  Results 

The  algorithms  presented  here  were  programmed  and  their  performance 
measured  during  various  experiments.  The  programs  were  run 
on  an  IBM  360/44  computer  with  a  2311  disc  unit  as  a  backup  store.  For 
the  index  element  size  chosen  (14  8-bit  characters)  and  index  size 
generally  used  (about  10,000  index  elements) ,  the  average  access  mechanism 
delay  for  this  unit  is  about  50  ms,  after  which  information  transfer 
takes  place  at  the  rate  of  about  90  ys  per  index  element.  From  these  two 
parameters,  our  analysis  predicts  an  optimal  page  size  (2k)  on  the  order 
of  120  index  elements. 

The  programming  included  a  simple  demand  paging  scheme  to  take  advan¬ 
tage  of  available  core  storage  (about  1250  index  elements*  wortn)  and  thus 
to  attempt  to  reduce  the  number  of  physical  disc  operations.  In  the 
following  section  by  virtual  disc  read  we  mean  a  request  to  the  paging 
scheme  that  a  certain  disc  page  be  available  in  core;  a  virtual  disc 
read  will  result  in  a  physical  disc  read  only  if  there  is  no  copy  of 
the  reques ted  disc  page  already  in  the  paging  area  of  core  storage.  A 
virtual  disc  write  is  defined  analogously. 

At  the  time  of  this  writing  ten  experiments  had  been  performed. 

These  experiments  were  intended  to  give  us  an  idea  of  what  kind  of 
performance  to  expect,  what  kind  of  storage  utilization  to  expect,  and 
so  forth.  For  us  the  specification  of  an  experiment  consists  of  choosing 

1)  whether  or  not  to  permit  overflows  on  insertion, 

2)  a  number  of  index  elements  per  page,  and 
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0  a  sequence  of  transactions  to  be  made  against  an  initially 
empty  index. 

At  several  points  during  the  perfcrma~  e  of  an  experiment  certain  per¬ 
formance  variables  are  recorded.  From  these  the  performance  of  the 
algorithms  according  to  various  performance  measures  can  be  deduced;  to 
wit 


1)  %  storage  utilization 

2)  average  number  of  virtual  disc  reads /t ransaction 

3)  average  number  of  physical  disc  reads /t ransaction 

A)  average  number  of  virtual  disc  writes/insertion  or  deletion 
3)  average  number  of  physical  disc  writes/insertion  or  deletion 
h )  average  number  of  transactions/second. 

’.ve  now  summarize  the  experiments.  Each  experiment  was  divided  into 
several  phases,  and  at  the  end  of  each  of  these  the  performance  variables 
were  measured.  Phases  are  denoted  by  numbers  within  parentheses. 

i. !  :  2)  o  !  ements/page  ,  overflow  permitted. 

(1)  10000  insertions  sequentiaJ  by  key, 

td)  30  insertions,  30  retrievals,  and  100  deletions  uniformly 
random  in  the  key  space. 


110  e  1  emeu t s/page 

;  otherwise  identical  to 

El. 

30  c  ItT cut  s  / pa  ge 

;  otherwise  identical  to 

El. 

1 10  c  I  L  s  /page 

,  i  »ve  r  f  I  ow  pe  rmi  1 1 e d . 

\  !  *  I  oi)i  hi  i  nsert 

ions  sequential  by  key, 

ill  !00U  |V[  riev 

a  Is  uniformly  random  in 

key  space. 
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(3)  10000  sequential  deletions. 

E5 :  120  e  lemen  ts /page  ,  overflow  not  permitted. 

(1)  5000  insertions  uniformly  random  in  key  space, 

(2)  1000  retrievals  uniformly  random  in  key  space, 

(3)  5000  deletions  uniformly  random  in  key  space. 

E6:  Overflow  permitted;  otherwise  identical  to  K5. 

E7:  120  elements /page,  overflow  permitted. 

(1)  5000  insertions  sequential  by  key, 

(2)  6000  each  insertions,  retrievals,  and  deletions  uniformly 
random  in  key  space. 

E9:  250  elements/page;  otherwise  identical  to  E8. 

E10:  120  e lemen ts /page ,  overflow  permitted. 

(1)  100,000  insertions  sequential  by  key, 

(2)  1000  each  insertions,  deletions,  and  retrievals  uniformly 
random  in  key  space, 

(3)  100  group  retrievals  uniformly  random  in  key  space,  where 
a  group  is  a  sequence  of  100  consecutive  keys  (statistics 
on  the  basis  of  10000  transactions) , 

(4)  10000  insertions  sequential  by  key,  to  merge  uniformly 
with  the  elements  inserted  in  phase  (1). 
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